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BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] This invention relates to methods for transferring information from one 
computer resource to another during which the information is translated from an 
5 initial natural or native language to a selected destination language. 



Background of the Invention 

[0002] Modern multi-tasking computers provide a variety of user interfaces for 
controlling multiple application programs and system functions which operate 

10 simultaneously. Some of the most widely used multi-tasking computer systems are 
personal computers ("PC") running a multi-tasking operating system ("OS") such as 
International Business Machines' ("IBM") OS/2 [TM] or AIX [TM, Microsoft 
Windows [TM], and Apple Computer's MacOS [TM]. Other operating systems may 
be used with personal computers as well as larger computers such as enterprise-class 

15 computers, such as UNIX, Sun Microsystems' Solaris [TM], Hewlett Packard's 

HP-UX [TM], and the "open sourced" LINUX. Smaller computing platforms such 
as held-held computers, personal digital assistants ("PDA"), and advanced wireless 
telephones may run operating systems targeted for such hardware including Palm 
Computing's PalmOS [TM] and Microsoft's Windows CE [TM]. Additionally, there 

20 are many "proprietary" and less widely-used computing platforms and operating 
systems which also allow users to control and run multiple programs and system 
functions simultaneously. 
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[0003] Many of these systems will use tabs, icons, windows, frames, pages and 
special key combinations to allow a user to switch between user interfaces ("UI") for 
each program and system function which is being executed, or to start or stop the 
execution of a program or system function. For example, in a personal computer 
5 running MS Windows [TM], the user may first start a web browser program running 
using several methods (e.g. double clicking an icon on the desktop, selecting the 
program from a Start Programs list, operating a "hot key", etc.), and then may start a 
document editor program using similar methods. Each program establishes a user 
interface such as its own "window". The user can then control a program by 

10 selecting its window using one of several available methods, such as selecting a 

button or icon on a command bar, activating a "task list" and selecting a program, etc. 
As a result, a user can start and run many programs simultaneously, periodically 
switching between their user interfaces to accomplish work or entertainment tasks as 
needed. Other computing systems provide similar basic user control capabilities, 

15 albeit with a variety of user controls to switch between programs and system 
functions. 

[0004] Users often wish to copy or transfer information or "content" from one 
program or system function to another. For example, a user may be preparing an 
invoice for a client using a word processor program, but may also be simultaneously 
20 using a database or spreadsheet program to perform various calculations. Using 

"copy and paste" functions of the application programs and the operating system, the 
user may select information from a source program (e.g. the spreadsheet), and "paste" 
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it into the destination program (e.g. the invoice being edited). Such a process is so 
common place in computer users' daily lives that it is rote, albeit each user may know 
several sequences of actions for several computers which he or she commonly uses 
(e.g. one process on his home PC, another on his PDA, and another on his networked 
5 terminal at work). These memorized methods may typically include several steps of 
clicking on icons, dropping down lists, highlighting information, and using navigation 
controls within program UI's. 

[0005] For example, turning to Figure 1, a "windows" style user interface is 
depicted to illustrate a process of "copying" information from a web browser program 

10 to a word processor file via a "clipboard" memory. In this system, each program 
provides a window (2, 3, 104) which can be closed (9, 9') to end the program, 
maximized (8, 8') to view the full UI for that program, or minimized (7, 7') to leave 
the program running but deactivate the UI (e.g. clear the UI window from the screen). 
In this example, these controls are located in a command bar (4, 4') along the top of 

15 the UI window, but many other variations are known in the art. 

[0006] Each UI window also typically has navigation controls such as left panning 
(15, 15'), right panning (13, 13'), and horizontal scroll (14, 14') controls, as well as up 
panning (10, 10'), down panning (12, 12'), and vertical scroll (11, IT), for viewing 
areas of information and content not completely viewable in the UI. Information, 

20 icons, text, graphics, etc., are shown or displayed within (16, 18) the UI window 
according to the scroll and panning control settings. More recently, the term 
"content" (16, 18) has been used to collectively refer to all types of information which 
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may be displayed or presented in a user interface, including but not limited to text, 
graphics, still images, animated images, video, audio, and hyperlinks. 
[0007] Now suppose for the purpose of our example, the user has started a word 
processing program which provides a first UI window (2), and a web browser which 
5 provides a second UI window (3). Also suppose that the user is researching 

information on the Internet using the web browser while authoring a paper which is 
being edited simultaneously using the word processor. 

[0008] In this example, the user has found information (19) at a hypothetical web 
address (17) that he wants to "quote" in his or her paper. So, the user must first move 

10 the cursor (104) in the word processor to select an insertion point for the information, 
then must switch to the web browser UI, select the text (19) in the source content, 
operate a "copy" command in the web browser UI which copies (101) the content into 
a buffer (100) such as a "clipboard", switch back to the word processor UI, and 
operate a "paste" or "insert" command, which results in the copied content (19) being 

15 inserted into the destination document at the point of insertion (103). The user can 
repeat this process for many different program UI's (106). 
[0009] In some software and hardware configurations, the copy buffer may be 
provided within a suite of application programs which are "tightly coupled" or related. 
Such suites cooperate with each other in ways not possible with software programs 

20 provided by differing suppliers. In many cases, however, the operating system 

provides a buffer function which is generally accessible by all programs, such as the 
clipboard in the MS Windows [TM] operating system. 
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[0010] Also, in some situations, the original content with its original format may 
not be acceptable by the destination program, and as such, a specialized paste or 
insertion function (105) may be provided by the destination program or operating 
system which converts the content to a form useful by the destination program. For 
5 example, text copied from a web page may include color, size, font, style, and 

hyperlink reference information embedded in the base Hyper Text Markup Language 
("HTML") of the source web page. However, not all word processors are able to 
interpret all of these special codes and identifiers, so a "paste as plain text" option 
may be provided by a converter or translator (105) function. 
10 [0011] So, to illustrate the complexity and tedious nature of such ordinary 

operations, we present the steps in full to accomplish this example scenario of simply 
transferring a block of formatted text from a web page to a word processor program, 
starting from a point where the user is editing the destination document in the word 
processor: 

15 (a) navigate to the insertion point in the destination document using the 

word processor UI window controls (e.g. multiple clicks on scroll, 
panning or page up/page down keys); 
(b) optionally select text or content in the destination document which is 
to be replaced; 

20 (c) switch to the web browser UI window (e.g. click on an icon in a task 

bar, activate a task list and pick a running web browser program, etc.); 
(d) navigate in the web browser UI window to find the text or content 
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desired to be transferred into the document (e.g. use panning, scrolling, 
or page up/page down keys); 
(e) select the source content or text (e.g. click-and-drag over the content 
to highlight it) 

5 (f) transfer the content to a copy buffer (e.g. click on "Edit" command, 

select "copy" option or type Alt-E, Alt-C); 
(g) switch back to the word processor UI window (e.g. (e.g. click on a 
icon in a task bar, activate a task list and pick a running web browser 
program, etc.); and 

10 (h) operate a "paste" command in the word processor UI window (e.g. 

click on "Edit" command, select "paste" option or type Alt-E, Alt-P). 



[0012] Each of these operations may actually require several steps (clicking, 
scrolling, selecting, typing, etc.), so this minimal process may represent 7 to 25 actual 

15 user actions. This process must be repeated for each block of text or content to be 
transferred from multiple program UI windows (106), and additional steps may be 
necessary to achieve a "special paste", as described above. Also, if the same text or 
content is to be inserted into the destination document for file at multiple locations, 
the last few operations of this process (h) in addition to some navigation actions must 

20 by performed by the user. 

[0013] As a result, consolidating information from multiple sources of information 
may be extremely tedious, frustrating, and tiresome using the currently available 
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methods and apparatuses provided in such computing systems. Some systems may 
provide notably more "user friendly" or intuitive methods, while other systems are 
much more difficult and "clunky" to use. 

[0014] Turning to Figure 2, this process is generalized. Starting at a point or time 
5 (21) when the user is actively working with the destination program UI, the user must 
navigate (22) within the present document, file, or other computer resource to a point 
where the content insertion is to be made, including selecting any content which is to 
be replaced. Then, the user must switch (23) to the UI of the first source of 
information, navigate (24) to the first source content to be transferred, select that 

10 content, and operate (25) a copy or cut control in the first source UI. 

[0015] Next, the user must switch (26) back to the destination UI, and operate (27) 
an insert or paste command in that UI. If (28) the user wants to insert or paste that 
content into multiple destinations, the user must navigate (29) to each destination and 
operate (27) the paste or insert command in the destination program UI, until all 

15 insertions have been made for that source information. 

[0016] If (200) the user desires to transfer information from other points in the 
same source, or from other sources, the user must repeatedly switch (201) to a source 
UI, navigate to a source content point, select source information, operate (25) a copy 
or cut operation, switch (26) back to the destination UI, and paste or insert (27) the 

20 content, until all information has been transferred. 

[0017] Implied, but not shown in detail, in this generalization of the process can be 
multiple user actions for each general step. Optionally, options such as conversion of 
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the content may be necessary, which requires additional user actions (e.g. the "paste 
as plain text" example). 

[0018] So, it is possible that in the course of authoring a paper using a word 
processor and information from several sources, the user may have to perform 
5 hundreds of tedious actions, commands, selections, navigation operations, etc. 
[0019] In this paradigm, certain conventions have evolved into place which only 
moderately simplify or reduce the burden of such operations. For example, 
performing a "cut" operation usually deletes the selected source content from the 
source file, and places a copy of it into the transfer buffer, sometimes overwriting the 

10 current contents of the transfer buffer. A "copy" operation typically leaves the 
selected information unchanged in the source and only places a copy of the 
information in the transfer buffer. Additionally, in the destination UI, a "paste" or 
"insert" command may copy the contents of transfer buffer to a selected point in the 
destination document or file, leaving a copy in the transfer buffer for additional pastes 

15 or insertions. 

[0020] In some programs, a "paste special", "import from clipboard", or similar 
command may be available with several conversion options to perform a minimal 
conversion process on each transfer. However, even though the user may be 
performing the same "paste special" command over and over, the typical UI does not 
20 memorize or "learn" this process, so the user is forced to respond to a number of 
redundant options and dialogs on each paste operation. 
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[0021] The same user interface conventions are followed by many computer 
systems not only for content or information within a computer resource such as text 
and graphics within a file, but also for resources (e.g. files, shortcuts, icons, 
mappings, etc.) within a computing environment (e.g. file system, directories, folders, 
5 etc.). For example, when working with a MS Windows [TM] operating system and 
running the Windows Explorer program, a user may select a file, directory or folder to 
move, execute an "Edit - Cut" command sequence, navigate to another directory or 
drive, and execute an "Edit - Paste" command to move the selected resource to the 
new destination. Similarly, by selecting the source resource, executing a copy 

10 command, and then executing a paste command to one or more destinations, the 
original resource is not changed but copies of it are deposited at the destination 
points. Further, by selecting and copying a source resource, then selecting a 
destination resource, replacement of the destination resource may be accomplished. 
[0022] However, as source information may or may not be completely compatible 

15 with destination environment, the user, even when using the related invention, may be 
required to make certain tedious and inconvenient operations to perform the 
information transfer usefully. 

[0023] For example, consider a situation where the source information is a 
graphically rich section of a web page, including text and color photographs. Further 
20 assume for the purposes of this example that the color photographs are stored in the 
source document as Joint Photographic Experts Group ("JPEG") format data objects. 
If the user attempts to transfer this selected information (e.g. text + photograph) to a 
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destination which does not support JPEG photographs, such as a text-only editor, a 
problem may arise that cannot be completely handled by the related invention e.g. 
what to do with the photograph. In some other cases, destination editor may be able 
to handle other format images, such as Graphic Interface File ("GIF") images, but not 
5 JPEG images. 

[0024] The user may, after realizing this and with sufficient technical expertise, find 
a way to export the image and save it to a separate file, use another tool to convert the 
JPEG image to a GIF image, and then use the related invention to transfer the GIF 
image to the destination document. This process, however, requires the user to have 
10 the expertise necessary to make such an export and conversion, as well as to have the 
extra tool to perform the conversion. Further, if this is a task to be repeated often, 
such as cutting and pasting a considerable amount of information in this manner, it 
becomes tedious, tiresome, and error-prone. 

[0024] Additionally, in some situations, it is desirable to translate the initial spoken 
15 language of the source to another spoken language. For example, if a user is creating 
a Spanish-language newspaper and desires to quote an source which is provided in 
English, the present day systems require the user to perform all of the cut-and-paste 
steps as just described, as well as to some how perform a language translation on the 
English source text. The translation can be performed manually, or the user may 
20 have to retype the English text into a translation program, select an option to translate 
the text to Spanish, and then retype or cut-and-paste the Spanish text into the desired 
destination file or document. To achieve a computer-assisted translation such as this, 
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the user may use one of many well-known programs or online services, such as 
AltaVista's online BabelFish [TM] phrase translator. However, to use these existing 
tools, the user must treat the translation program (or web site) as yet another source 
and/or destination, and must perform many user operations to effect cutting and 
pasting from source to translator, and from translator to destination. If the user is 
translating several phrases several sources, and inserting the translated text into a 
plurality of destination points, this process can be very cumbersome and tedious. 
[0025] Therefore, there is a need in the art for a system and method to provide 
configurable automatic source-to-destination spoken language translation for 
transferring information from one or more source environments in one or more initial 
spoken language to one or more destination environments in a selected spoken 
language. 
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SUMMARY OF THE INVENTION 



[0026] The present invention allows computer information elements such as text, 
tables, graphics, and hyperlinks, to be intercepted during their transfer from a 
5 computer source to a computer destination, such as during a cut-and-paste operation. 
It is determined if each intercepted information element is expressed in a natural 
language (e.g. spoken or written language such as English, Japanese, Spanish, Farsi, 
etc.) which matches a user-specified natural language intended for the destination. 
[0027] For intercepted information elements which do not match the user-specified 

10 natural language for the destination, one or more natural language handling actions 
such as translation or isolation of the information elements are automatically 
performed in order to translate the elements to the desired destination language. 
Translated information elements and elements which were originally in the desired 
destination language are delivered to the destination, and isolated elements are placed 

15 in a data store for later review and/or exchange with other elements. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0028] The following detailed description when taken in conjunction with the 
figures presented herein provide a complete disclosure of the invention. 
[0029] Figure 1 illustrates the typical user interfaces and system actions of "cutting 
5 and pasting" information from one application program to another. 

[0030] Figure 2 shows the typical logical process in a general manner for 
transferring content from one application program or system function to another. 
[0031] Figure 3 depicts a generalized computing platform architecture, such as a 
personal computer, server computer, personal digital assistant, web-enabled wireless 

10 telephone, or other processor-based device. 

[0032] Figure 4 shows a generalized organization of software and firmware 
associated with the generalized architecture of Figure 1. 
[0033] Figure 5 illustrates the logical method of the present invention. 
[0034] Figure 6 depicts details of the logical process of translating transferred 

15 elements of information from a source NLS to a destination NLS. 

[0035] Figure 7 provides a functional diagram illustrating the translation of 
information elements, and optionally the isolation of elements which are not 
translated. 
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DESCRIPTION OF THE INVENTION 



[0036] The present invention is preferably realized in conjunction with either or 
both of the systems and methods described in the related patent applications which are 
5 entitled "System and Method for Content and Information Transfer Between Program 
Entities" and "System and Method for Automatic Information Compatibility 
Detection and Pasting Intervention", both of which were filed by Yen-Fu Chen, et al 
The former application provides an improved method for cutting and pasting 
information from multiple sources into a destination file, while the latter provides an 
10 improvement in which content is automatically converted to a digital format which is 
compatible with the destination file or computer resource. It will be recognized by 
those skilled in the art, however, that the present invention may alternately be realized 
independently of these related inventions, or in conjunction with other technologies 
and products. 

15 [0037] Throughout the present disclosure, we will utilize the terms "spoken 

language" and NLS synonymously. The acronym NLS has varying representation 
based upon the defining source, but generally relates to spoken and written 
human-readable language. For example, some sources define NLS as "natural 
language system", such as a voice recognition system which recognizes free speech 

20 phrases. IBM and Microsoft define the acronym NLS as "national language 

support", which encompasses an array of computing system options to adapt the 
system to geographically local spoken languages, including such options as selection 
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of a default character set, keyboard layout, etc. As such, we will utilize the acronym 
NLS to indicate a human-spoken or human-written language (e.g. English, Spanish, 
Japanese, Farsi, etc.), as opposed to a binary or computer-related language or format 
(e.g. not "C", Java, JPEG, HTML, etc.). Further, throughout our disclosure, we will 
5 refer to conversion of information from one spoken language to another spoken 
language as "translation". 



Summary of the Related Inventions 

[0038] According to one aspect of the first related invention, the user initially 
10 designates one or more insertion points or replacement areas for receiving transferred 

content in a destination UI, then switches to a source UI, highlights content to be 

transferred, and the system performs the copy or paste operation without any 

additional user action, including any conversion as may be necessary. 

[0039] Then, the user may simply navigate to another point in the same source, or 
15 switch to another source UI, select content, and it will be "pasted" automatically into 

the destination without the user having to switch back to the destination UI or 

perform any additional paste or insert command actions. 

[0040] According to an aspect of the second related invention, users are enabled to 
preselect or pre-designate one or more destination content area(s) or points, and then 
20 to only perform the highlighting action in the source files or documents to produce 
copy /paste results without any additional mouse clicks or touching the keyboard. 
Additionally, the second related invention automatically intercepts the transfer of the 
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information to the destination, detects information digital compatibility during 
information transfer (e.g. during a "pasting from buffer" operation"), determining if 
the information is compatible with the destination document, environment, or data 
construct. If the information is not compatible, the transfer is suspended, and the user 
5 is provided an opportunity to define a new rule, process, or macro regarding how to 
handle the incompatible information. Options include invoking a converter or 
translator, if one is available on the present system. Another option is to export the 
incompatible information to a separate data construct such as a separate file, and to 
provide a note or annotation in the destination file as to the removal of the 
10 information and its final location. 

Suitable Computing Platforms 

[0041] The present invention is preferably realized as computer-executable code 
such as compiled software, scripts, or portable programs, in conjunction with existing 

15 application programs, operating systems, and computer hardware. For purposes of 
completeness, we first present a generalized view in Figures 3 and 4 of typical 
computer hardware and software which is suitable for realization of our invention. 
Many variations of these computer platform details may be made without departing 
from the scope of the invention, as will be readily recognized by those skilled in the 

20 art. 

[0042] Common computing platforms such as personal computers, web servers, and 
web browsers, as well as proprietary computing platforms, may be used in realization 
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of the present invention. These common computing platforms can include, but are 
not limited to, personal computers as well as portable computing platforms, such as 
personal digital assistants ("PDA"), web-enabled wireless telephones, and other types 
of personal information management ("PIM") devices. 
5 [0043] Therefore, it is useful to review a generalized architecture of a computing 
platform which may span the range of implementation, from a high-end web or 
enterprise server platform, to a personal computer, to a portable PDA or web-enabled 
wireless phone. 

[0044] Turning to Figure 3, a generalized architecture is presented including a 
10 central processing unit (31) ("CPU"), which is typically comprised of a 

microprocessor (32) associated with random access memory ("RAM") (34) and 
read-only memory ("ROM") (35). Often, the CPU (31) is also provided with cache 
memory (33) and programmable FlashROM (36). The interface (37) between the 
microprocessor (32) and the various types of CPU memory is often referred to as a 
15 "local bus", but also may be a more generic or industry standard bus. 

[0045] Many computing platforms are also provided with one or more storage 
drives (39), such as a hard-disk drives ("HDD"), floppy disk drives, compact disc 
drives (CD, CD-R, CD-RW, DVD, DVD-R, etc.), and proprietary disk and tape drives 
(e.g., Iomega Zip [TM] and Jaz [TM], Addonics SuperDisk [TM], etc.). Additionally, 
20 some storage drives may be accessible over a computer network. 

[0046] Many computing platforms are provided with one or more communication 
interfaces (310), according to the function intended of the computing platform. For 
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example, a personal computer is often provided with a high speed serial port (RS-232, 
RS-422, etc.), an enhanced parallel port ("EPP"), and one or more universal serial bus 
("USB") ports. The computing platform may also be provided with a local area 
network ("LAN") interface, such as an Ethernet card, and other high-speed interfaces 
5 such as the High Performance Serial Bus IEEE- 1394. 

[0047] Computing platforms such as wireless telephones and wireless networked 
PDA's may also be provided with a radio frequency ("RF") interface with antenna, as 
well. In some cases, the computing platform may be provided with an infrared data 
arrangement (IrDA) interface, too. 

10 [0048] Computing platforms are often equipped with one or more internal 

expansion slots (311), such as Industry Standard Architecture ("ISA"), Enhanced 
Industry Standard Architecture ("EISA"), Peripheral Component Interconnect 
("PCI"), or proprietary interface slots for the addition of other hardware, such as 
sound cards, memory boards, and graphics accelerators. 

15 [0049] Additionally, many units, such as laptop computers and PDA's, are provided 
with one or more external expansion slots (312) allowing the user the ability to easily 
install and remove hardware expansion devices, such as PCMCIA cards, SmartMedia 
cards, and various proprietary modules such as removable hard drives, CD drives, and 
floppy drives. 

20 [0050] Often, the storage drives (39), communication interfaces (310), internal 

expansion slots (311) and external expansion slots (312) are interconnected with the 
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CPU (31) via a standard or industry open bus architecture (38), such as ISA, EISA, or 
PCI. In many cases, the bus (38) may be of a proprietary design. 
[0051] A computing platform is usually provided with one or more user input 
devices, such as a keyboard or a keypad (316), and mouse or pointer device (317), 
5 and/or a touch-screen display (318). In the case of a personal computer, a full size 
keyboard is often provided along with a mouse or pointer device, such as a track ball 
or TrackPoint [TM]. In the case of a web-enabled wireless telephone, a simple 
keypad may be provided with one or more function-specific keys. In the case of a 
PDA, a touch-screen (318) is usually provided, often with handwriting recognition 
10 capabilities. 

[0052] Additionally, a microphone (319), such as the microphone of a web-enabled 
wireless telephone or the microphone of a personal computer, is supplied with the 
computing platform. This microphone may be used for simply reporting audio and 
voice signals, and it may also be used for entering user choices, such as voice 
15 navigation of web sites or auto-dialing telephone numbers, using voice recognition 
capabilities. 

[0053] Many computing platforms are also equipped with a camera device (3 100), 
such as a still digital camera or full motion video digital camera. 
[0054] One or more user output devices, such as a display (313), are also provided 
20 with most computing platforms. The display (313) may take many forms, including a 
Cathode Ray Tube ("CRT"), a Thin Flat Transistor ("TFT") array, or a simple set of 
light emitting diodes ("LED") or liquid crystal display ("LCD") indicators. 
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[0055] One or more speakers (314) and/or annunciators (315) are often associated 
with computing platforms, too. The speakers (314) may be used to reproduce audio 
and music, such as the speaker of a wireless telephone or the speakers of a personal 
computer. Annunciators (315) may take the form of simple beep emitters or buzzers, 
5 commonly found on certain devices such as PDAs and PIMs. 

[0056] These user input and output devices may be directly interconnected (38', 38") 
to the CPU (31) via a proprietary bus structure and/or interfaces, or they may be 
interconnected through one or more industry open buses such as ISA, EISA, PCI, etc. 
[0057] The computing platform is also provided with one or more software and 
10 firmware (3101) programs to implement the desired functionality of the computing 
platforms. 

[0058] Turning to now Figure 4, more detail is given of a generalized organization 
of software and firmware (3101) on this range of computing platforms. One or more 
operating system ("OS") native application programs (43) may be provided on the 
15 computing platform, such as word processors, spreadsheets, contact management 

utilities, address book, calendar, email client, presentation, financial and bookkeeping 
programs. 

[0059] Additionally, one or more "portable" or device-independent programs (44) 
may be provided, which must be interpreted by an OS-native platform-specific 
20 interpreter (45), such as Java [TM] scripts and programs. 
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[0060] Often, computing platforms are also provided with a form of web browser or 
microbrowser (46), which may also include one or more extensions to the browser 
such as browser plug-ins (47). 

[0061] The computing device is often provided with an operating system (40), such 
5 as Microsoft Windows [TM], UNIX, IBM OS/2 [TM], LINUX, MAC OS [TM] or 
other platform specific operating systems. Smaller devices such as PDAs and 
wireless telephones may be equipped with other forms of operating systems such as 
real-time operating systems ("RTOS") or Palm Computing's PalmOS [TM]. 
[0062] A set of basic input and output functions ("BIOS") and hardware device 
10 drivers (41) are often provided to allow the operating system (40) and programs to 
interface to and control the specific hardware functions provided with the computing 
platform. 

[0063] Additionally, one or more embedded firmware programs (42) are commonly 
provided with many computing platforms, which are executed by onboard or 
15 "embedded" microprocessors as part of the peripheral device, such as a micro 

controller or a hard drive, a communication processor, network interface card, or 
sound or graphics card. 

[0064] As such, Figures 3 and 4 describe in a general sense the various hardware 
components, software and firmware programs of a wide variety of computing 
20 platforms, including but not limited to personal computers, PDAs, PIMs, web-enabled 
telephones, and other appliances such as WebTV [TM] units. 
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Logical Processes of the Invention 

[0065] We now turn our attention to disclosure of the present invention relative to 
the processes and methods preferably implemented as software and firmware on such 
a computing platform. It will be readily recognized by those skilled in the art that the 
5 following methods and processes may be alternatively realized as hardware functions, 
in part or in whole, without departing from the spirit and scope of the invention. 
[0066] In general, the present invention provides the user the ability to follow this 
process: 

1. Declare destination content area for pasting or insertion in a destination UI; 
10 2. Enable highlighting or selecting content to automatic copy selected 

information and store it in memory (e.g. buffer/clipboard) for future 
usage, as well as to automatically insert or paste the selected 
information into the pre-designated destination area; 

3. Switch to source UI's, and simply highlight or select the desired content 
15 portion(s) which triggers dynamic insertion/concatenation into the 

declared content field. 

4. Receive an automatic notification that a portion of the highlighted source 

information is not written in the same spoken language as the desired 
spoken language of the destination; and 
20 5. Define new rule or process for handling the content to be translated such 

that future similar situations are handled automatically according to the 
user's preferences. 
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[0067] Using the present invention, advantages over presently available methods 
and user interfaces are: 

1. User-friendly: the invention utilizes maneuvering techniques with which 

users are already familiar, such as double mouse clicks, dragging to 
highlight, etc.; 

2. Convenient: the invention provides a user a new way of selecting 

destination for paste operations, and offers a quicker way of copy/paste 
by eliminating keyboard strokes, mouse clicks, navigation and 
toggling between different program windows and UI's. 

3. Intuitive: Users can learn or "discover" that in this new mode, content 

highlighting triggers copy/paste effortlessly, immediately seeing the 
results of the highlighting action, and proceeding to experiment with 
various ways of applying and exploring this invention. 

4. Time-Saving: Reduces time to compile information from multiple sources 

by making copy-paste user interface methods much more efficient. 

5. Increases productivity: By reducing fatigue and tediousness in application 

program user interfaces, users are allowed to produce more accurate 
results with less effort in less time. 

[0068] Turning to Figure 5, a first logical process of the invention is shown at a 
high level. This method may be implemented as compiled code, scripts, or 
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interpretable code (e.g. Java, applets, servlets, etc.) in full or part within application 
programs, operating systems, server suites, utility programs, or proprietary code or 
hardware. 

[0069] While (21) creating or editing a computer resource such as a computer file or 
5 document, when a user wishes to insert or copy content from a source destination to 
the resource being edited, the shown method (50) may be employed. The source or 
sources may include points and areas within UI's of other programs and system 
functions, as well as within the destination resource which is being created or edited. 
[0070] Initially, the user may navigate (5 1) to a first insertion point and optionally 

10 highlight an insertion area to designate a first "paste" destination while in the current 
(destination) UI. If (52) more than one insertion points or areas are desired, the user 
may navigate to and select (53) additional destinations while still in the destination 
UI. Insertion points can be marked in a variety of ways, including placement of a 
graphical icon such as a caret (" A ") at the insertion point(s) or other suitable icon. 

15 Replacement destination areas can be marked in a variety of ways, including 

highlighting the selected text, graphics, information, or content in a special pattern, 
color, or both, or by making special changes to the selected information itself (e.g. 
changing the text to a different color, underlining the text, etc.). Preferably, a user 
interface or dialog box is also provided to allow the user to manage destination 

20 insertion points and replacement areas, such as to create additional points and areas, 
and to remove points and areas. 
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[0071] When all destination points and areas have been designated, the user enables 
(54) the automatic content transfer function of the invention through an appropriate 
user control such as right-clicking with the mouse to bring up a dialog box, selecting 
an option from a drop-down list, or operating a special icon, key or key sequence. 
5 According to the present invention, the user is allowed to select advanced options, 
such as rules for concatenation or content conversion, or whether cutting (e.g. source 
deletion) is performed as well as copying on each subsequent selection operation, as 
well as designating a spoken language for the destination(s). For example, the user 
may specify that the destinations which were previously designated (52) are to receive 
10 Spanish content only. 

[0072] Next, the user switches (55) to the first source UI from which information is 
to be transferred, navigates to the first source point, and highlights or selects (56) 
source content. 

[0073] NLS handling is performed (501), described in more detail in the following 
15 paragraphs, and the information which is expressed in the user-selected natural 

language is then automatically copied into the transfer buffer, and subsequently pasted 
(58) into the designated destination point(s) and area(s), without need to switch back 
to the destination UI. 

[0074] If (57) more source content is to be transferred, the user may continue to 
20 navigate to additional points and to select (56) additional content for automatic 
pasting into the destination resource from within the current UI, or the user may 
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switch (500, 501) to another UI and proceed with selecting (56) for automatic pasting 
(58) into the destination resource. 

[0075] If the concatenation option is selected, upon selection of a content block or 
area, it is appended to the existing contents of the transfer buffer, and the user is given 
5 the option to perform the automatic pasting into the destination point(s) and area(s), 
without need to switch back to the destination UI. 

[0076] If the source cutting operation is selected, upon selection of a content block 
or area, it is deleted from the source resource (assuming the user has the rights to 
modify the resource), placed in the transfer buffer, and pasted, concatenated or 

10 converted as determined by the other options. 

[0077] When (57) all source information has been copied, the information transfer 
operation is complete (59), and the user returns to the initial (e.g. destination) UI to 
continue editing or creating (21') the computer resource. 
[0078] As an example and comparison now between the user control method 

15 typically employed and the user control method provided by the present invention, we 
present the following case. On a MS Windows ]TM] operating system, a user who 
has several windows opened intends to compose an email in Spanish using a web 
based mail program. Further, the user plans to generate the content of this email from 
his or her other open windows by using the copy/paste functions, specifically from 

20 Microsoft Word [TM] word processor and from Lotus Notes [TM] application 
programs. 
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[0079[ For this example, suppose that the email message is to be created from an 
English paragraph in MS Word, and from a French paragraph in Lotus Notes. Also, 
presume that the online phrase translator BabelFish by AltaVista is to be used to 
provide the English to Spanish and the French to Spanish translations. So, 
traditionally what the user would be required to do in order to accomplish this task in 
the shortest time frame is the following: 

1. open the email composer window; 

2. switch to the window for MS Word using Alt-Tab; 

3. highlight the desired English text in the MS Word document; 

4. hit Ctrl-C to copy the selected text into the clipboard; 

5. hit Alt-Tab until toggle to the BabelFish translator program window; 

6. click on the text area or entry point wherein the source language 
paragraph is to be entered; 

7. select English-to-Spanish as translator function; 

8. highlight the produced Spanish translation in the translator UI; 

9. hit Ctrl-C to copy the selected Spanish text into the clipboard; 

10. hit Alt-Tab until toggle to the email composer window; 

11. click on the text area or point where the translated paragraph is to be 

placed; 

12. hit Ctrl-V or select Edit-Paste to insert the Spanish text copied from 

MS Word and translated by the BabelFish web service; 

13. switch to the Lotus Notes window using Alt-Tab; 
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14. highlight or select the desired French text in Notes; 

15. hit Ctrl-C to copy the text to the clipboard; 

16. hit Alt-Tab until toggle to the BabelFish translator program window; 

17. click on the text area or entry point wherein the source language 
paragraph is to be entered; 

1 8. select French-to-Spanish as translator function; 

19. highlight the produced Spanish translation in the translator UI; 

20. hit Ctrl-C to copy the selected Spanish text into the clipboard; 

21 . hit Alt-Tab to switch back to the email composer window; 

22. place the cursor on the end of the first inserted paragraph; and 

23. hit Ctrl-V or select Edit-Paste with the mouse or keyboard to append 
the Spanish text from the Notes window (and translated by BabelFish) 
to the initially inserted Spanish content. 

[0080] As this illustration shows, just combining two pieces of information from 
two sources into one destination and performing translations on the information can 
take 23 user steps or more using the existing processes. 

[0081] Using our invention, however, this process is shortened significantly to 
achieve identical result without ever having to touch the keyboard: 

1. open the email composer window, place cursor at desired insertion 
point; 

2. enable auto-pasting and designate an insertion point or replacement 



-30- 



AUS920030667US1 Patent Application 

area (e.g. by right clicking in the email text area or by double clicking 
on the left mouse button while in the email message text area), 
selecting an auto-paste option (assume no concatenation, no 
conversion and cutting options are selected) and select Spanish 
as the desired destination spoken language; 

3. switch to the MS Word window using Alt-Tab; 

4. highlight the first block of desired English text causing the selected 

text to be automatically translated to Spanish and inserted in 
the email composer window at the designated destination point; 

5. switch to the Lotus Notes window using Alt-Tab; 

6. highlight the block desired French text causing the selected 

text to be automatically translated to Spanish and inserted in 
the email composer window following the first block; and 

7. switch back to the email composer window using Alt-Tab. 



[0082] There are alternative implementations available to declare destination 
context area. For example, consider the situation where the email message is created 
from many windows or many sections of a few windows, the number of toggles 
between program windows and highlighting/Ctrl-C/Ctrl-V operations could cause 
intense frustration and stress on the user. In systems running operating system which 
are not completely stable, such window or frame switching may also increase the 
possibility of an OS lock up or crash. 
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[0083] Similar to the email example, this invention can be used by helpdesk agents 
filling out problem descriptions from known issues or solutions, users completing a 
form based on known information (creating resume, registration, etc.), and even 
programmer and software testers attempting to write new code or test cases by using a 
template or reusing available code. 

[0084] There are plentiful situations where an efficient way of copying content and 
inserting it into one or more desired locations can significantly improve productivity, 
save time, reduce overall operational cost, and radically increase user satisfaction. 
[0085] In an alternate embodiment of the present invention, each selection of source 
content may be followed by addition of a specified delimiter between the next 
selection of source content. For example, in the email composition scenario 
previously discussed, a delimiter such as a space, carriage return, HTML horizontal 
line, or text note may be automatically added between the MS Word paragraph and 
the Lotus Notes paragraph. In a first advanced implementation of this option, a 
descriptive annotation may be appended before or after the content, such as: 

<copied from MS Word: c:\my_files\document.doc , 
translated from English to Spanish> 

and: 

<copied from Lotus Notes: e:\network_backups\advice.lwp s 
translated from French to Spanish> 
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[0086 These notations can include web site addresses, as well, and optionally time 
and date information: 

5 <copied from www.help.ibm.com\laptops\upgrades on 3-15-2003> 

[0087] Alternate embodiments of this notation include, but are not limited to, 
annotations made in extensible Markup Language ("XML"), and possibly including a 
time stamp such as a local clock and calendar value, or a Coordinated Universal Time 

10 ("UTC") value. 

[0088] According to another alternative aspect of the present invention, the 
destination areas and points may be saved in association with a computer resource 
(e.g. a specific file), or as a named template. These insertion points and areas can 
then be recalled so that new information from multiple sources can be quickly and 

15 routinely compiled. This function is particularly useful for creating news letters, 
status reports, and the like. 

[0089] As will be recognized by those skilled in the art, the use of text as the 
content copied from a source to a destination in the foregoing examples is not meant 
to imply that the present invention is limited to such content types. In fact, it may be 
20 used to transfer content of any format which is compatible with the transfer buffer 
implementation. For example, video clips, graphics, hyperlinks, audio clips, and the 
like may be handled by the invention provided that the transfer buffer is implemented 
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in a manner compatible with storing such information. According to one optional 
implementation detail, the user may define a NLS handling rule which isolates certain 
types of content for later review, such as a isolating pictures for later review to see if 
they should be exchanged for alternate pictures more suitable for the destination 
5 language and culture. 

[0090] Another desirable but not critical aspect of the invention is to provide an 
"undo" function, with or without an action log. By keeping track of the source to 
destination transfers, and especially the source deletions when "cutting" is selected, 
the user may reverse any operation previously made. The tracking record of actions 
10 taken can preferably be produced in a human readable form, which is useful in 
version tracking, revision control, and similar activities. 



NLS Handling 

[0091] Turning to Figure 6, details of NLS handling (501) according to the present 
15 invention are shown. A set of NLS handling rules (61), if already defined, are 

consulted initially to determine (60) if all the elements of the selected source content 
are in the same spoken language as the user-select spoken language of the 
destination(s). Alternatively, the spoken language of the destination may be 
automatically determined by examining the words and phrases which may already 
20 exist in the destination, and comparing them to a dictionary to match them to a spoken 
language. This same method may be employed to automatically determine the spoken 
language of each source information element selected for transfer. 
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[0092] For example, Table 1 shows a basic set of NLS handling rules which can be 
implemented in a text file for a particular hypothetical destination document editor 
called "JotPro". Additionally, assume a hypothetical translator program or service 
called "QuickXlate" is available to be called or invoked on supplied text strings to 
perform a spoken language translation. 



Table 1. Example "JotPro" NLS Handling Rules 



<NLS_handling_rules> 

<destination> Jotpro </destination> 
<destination_versions> all </destination_versions> 
<text_Jranslation_rules> 
<translate_rule> 

<source_lang> English </source_lang> 
<destination_lang> Spanish </destination_lang> 
<translator> QuickXlate </translator> 
</translate_rule> 
<translate_rule> 

<sourceJang> French </source_lang> 
<destination_lang> Spanish </destinationJang> 
<translator> QuickXlate </translator> 
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</translate_rule> 
<text_translation_rules> 
<isolation_rules> 

<isolate_types> pcx, gif, tif, tiff, jpg, jpeg </isolate_types> 
</isolation_rules> 
</NLS_handling_rules> 



[0093] Table 1 is expressed in a markup-style language, such as extensible Markup 
10 Language ("XML"). Other formats and language are available to implement such as 
set of compatibility rules, including but not limited to plain text, macro languages, 
tables, databases, etc. It defines that source in English or French which needs to be 
translated into Spanish is to be handled by the "QuickXlate" program or service, and 
that graphics elements of the types Microsoft Paintbrush (PCX), Graphic Interchange 
15 format (GIF), Tagged Information Format (TIF, TIFF), and Joint Photographic 
Experts Group (JPG, JPEG) format are to be isolated for later review by the user. 
[0094] So, each element (e.g. paragraph or sentence of text, graphic image, video 
clip, audio clip, animation, etc.) is checked (60) against the set of NLS handling rules 
(61), and if an element needs to be translated, it is marked for translation. If (62) all 
20 elements are already in the desired destination spoken language, then transfer of the 
unmodified source content (all elements) is allowed (63). 
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[0095] For each element to be translated (or isolated), the translation function is 
performed according to the appropriate handling rule, such as invoking a translator 
program, DLL, web service, etc., using an application programming interface (API) 
call, or other suitable means to invoke an existing translator process or program. 
5 There are a number of available protocols for invoking remote services such as a 
Common Object Request Broker Architecture ("CORBA"), Simple Object Access 
Protocol ("SOAP"), and many ways to transmit the data representing the phrase to be 
translated and the translated phrase such as extensible Markup Language ("XML") 
over hyper text transfer protocol ("HTTP"). Lingua Translator Service via SOAP and 
10 XML is one such online translator service. Another such service is provided by 
PROMT Ltd. of St. Petersburg, Russia. 

[0096] If (66) no applicable rule for an element is found in the NLS handling rules 
(61), then a user interface is preferably invoked to allow the user to define a new rule 
or action for handling the elements of that type. When NLS handling rules for all 

15 incompatible elements have been found or defined, the translations performed (68). 
[0097] Isolation is a special type of NLS handling which allows certain types of 
elements to be "separated" from the source content and stored in a separate data 
construct, such as a file on the system hard drive, or a file in system memory. In the 
context of NLS handling, some element types such as pictures, clip art, audio, music, 

20 etc., may need to be exchanged for more appropriate types according to the 

destination spoken language or culture. For example, a source image of the Eifel 
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Tower in Paris may need to be exchanged for an image of Madrid if creating a 
document intended for viewing in Spain. 

[0098] Turning to Figure 7, the isolation process is shown as well as the process of 
invoking one or more translators according to the present invention. In this example, 
5 the English text "Welcome to Our Web Site!" as well as a graphic image (shown as 
the circle, triangle, rectangle combination) have been selected (19) for transfer (18) 
from a first UI. In this example, the NLS Handler (501) has been configured to 
intercept the insertion of the English phrase, and to translate it to Spanish using one or 
more translator services (700) before inserting it into a designated point (103) in a 
10 destination UI. Additionally, in this example, the selected image is isolated to an 
isolated content store (69) for later review and possible exchange with a more 
appropriate image. Selected and copied elements from other program UTs (106) also 
may be automatically translated or isolated similarly. 

15 Conclusion 

[0099] As such, the present invention may be realized in a variety of forms, 
programming languages, methodologies, and operating systems on a variety of 
computing platforms without departure from the spirit and scope of the present 
invention. A number of example embodiment details have been disclosed as well as 
20 optional aspects of the present invention in order to illustrate the invention, but which 
do not define the scope of the invention. Therefore, the scope of the present invention 
should be determined by the following claims. 
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